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PATENT 
16869C-013610US 
HAL-ED 146-1 

METHOD FOR VISUALIZING MULTIDIMENSIONAL DATA 

CROSS-REFERENCE TO RELATED APPLICATIONS 
The present invention is a continuation application of U.S. Application No. 
09/687,058, filed October 12, 2000 which is herein incorporated by reference for all 
purposes. 

BACKGROUND OF THE INVENTION 
The present invention relates generally to visualizing and analyzing 

multidimensional data, and more specifically to methods, systems and computer software 

for performing process analyses, including clinical pathways analysis. 

Broadly defined, clinical pathways analysis refers to analyzing a course of 

clinical procedures. Sometimes, clinical pathways analysis is called critical pathways 

analysis. 

Conventional data analysis techniques are lacking in the area of processing 
complex data analysis requests, such as those that might arise in performing a clinical 
pathways analysis. For example, processing a request, such as "I want to see the course 
of procedure of the patients who were treated very differently from the others," or "I want 
to see the difference in patterns of procedures among doctors, especially for focusing on 
the doctor who uses the most cost-troubled procedures," are difficult for conventional 
approaches to answer. One reason is that such requests comprise of two or more 
questions from different points of view, and the result of the first question affects the 
answer to the next question. In another example, processing a request such as, "I want to 
compare the pattern of procedures between two patient groups who may have had a 
Procedure-A applied to them on the admission day" is difficult for conventional 
approaches, because this request applies a dynamically created categorization created to 
the patients. Another area that conventional techniques can benefit from improvement is 
in the interchange of the information between visualizing the results and providing the 
user an environment for the user's interaction with multidimensional data. 

What is really needed is a method that efficiently answers complex 
requests about data, and that is capable of operating with dynamic categorization. 
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SUMMARY OF THE INVENTION 
The invention provides interactive visualization techniques. One 
technique uses graphs not only for visualizing data from multiple points of view, but also 
5 for guiding users in selecting subsets of the data. The selection of subsets in one graph 
reflects the calculation and visualization of the other graphs, which dynamically 
categorizes the data in certain dimensions. This selection-visualization interaction among 
the graphs can operate forward as well as backwards. The approaches to clinical pathway 
analysis of the present invention can provide a clear presentation of the information, so 

10 that the difference of the pattern and distribution can be easily grasped, and flexibility in 
selecting the patient groups or procedures in specific embodiments. 

Clinical pathways analysis comprises the following types of analyses: (1) 
visualizing time-course of a clinical procedure, (2) comparing the time-course of the 
clinical procedure as applied to selected patients or patient groups, (3) visualizing an 

1 5 amount of the clinical procedure for each patient or patient group, (4) comparing the 
amounts of clinical procedures for each patient among the selected procedures, and (5) 
categorizing patients and procedures dynamically. 

The invention provides visualization techniques for process analysis, 
which includes an analysis of clinical procedures. In process analysis, process data is 

20 abstracted into three or more dimensions, such as for example, a process, a time and a 

type of procedure. A plurality of visualization devices for process analysis comprises in a 
specific embodiment of a two-dimensional map and a one-dimensional bar- or line-graph, 
which enable visualizing the data in three dimensions. The two-dimensional map shows a 
pattern or a correlation between two dimensions, such as a time and a type of procedure, 

25 for example. The one-dimensional graph shows a quantity along one dimension, such as 
each process. Regions of interest (ROI) on the dimensions can be selected on each graph, 
which enables easily selecting target points of interest while confirming them on the 
graph. The information comprising the selected ROI is interchanged and the data is 
sliced according to the ROI. This slicing comprises calculating a subset of data of which 

30 values in the corresponding dimensions are in the ROI. The other graphs are re-drawn 

using the sliced data. This function enables the user to dynamically categorize the data by 
selecting the ROI. Further, it enables slicing the multi-dimensional data in some 
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dimensions while confirming the results in other dimensions. Yet further, it enables the 
user to compare certain regions, and to determine majority or to pick up outliers. 

The invention further provides, in specific embodiments, a method for 
analyzing process data that comprises a variety of elements. The method can include 
5 abstracting the process data into three or more dimensions. The three dimensions 

comprise, for example, a process dimension, a time dimension, and a type of procedure 
dimension in a specific embodiment. The method also includes providing a plurality of 
visualization devices enabling visualization of the process data one or more of the three 
dimensions. The visualization devices can be, for example, a two-dimensional map (2D- 

10 map) and a one-dimensional graph (ID-graph). Furthermore, a combination of 

visualization device types, not limited to the 2D-map and the ID-graph, may be used in 
some specific embodiments. For example, the ID-graph can be replaced by a second 2D- 
map to show four-dimensional data, or the 2D-map can be replaced by a 2D-scatter graph 
to show the distribution of data, in various specific embodiments. The one-dimensional 

15 graph can be a bar graph, a line graph, a pie chart, scatter-gram, and the like. The method 
includes indicating one or more correlations between two or more of the dimensions 
using a first visualization device and indicating a quantity measure, for example, by one 
or more of the three dimensions using a second visualization device. A selection of one 
or more regions of interest (ROI) is received from the user according to the method. The 

20 selection is made from one or more dimensions chosen from among the three dimensions. 
The selection is indicated on one or both of the first visualization device and the second 
visualization device. Then, the method provides for exchanging information about the 
selected ROI between the first visualization device and the second visualization device. 
Then, a first subset of the process data is calculated based upon values present in the ROI 

25 along one or more of the three dimensions. The method provides for redrawing the first 
visualization device and the second visualization device based upon the first subset of the 
process data. 

In specific embodiments, a third visualization device is also provided. 
This third visualization device indicates one or more correlations between the three 
30 dimensions, for example. In these embodiments, the method displays one or more of the 
first visualization device, the second visualization device, and the third visualization 
device on a computer screen. 
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In another representative embodiment, the method can include receiving a 
second selection of one or more of the plurality of regions of interest (ROI). This second 
selection is from one or more dimensions chosen from among the three dimensions. The 
second selection is indicated on the first visualization device and/or the second 
5 visualization device. The method also includes calculating a second subset of the process 
data. The second subset comprises values present in the second selection of regions of 
interest along one or more of the three dimensions. Displaying the first subset of the 
process data and the second subset of the process data together on one or both of the first 
visualization device and the second visualization device is also included in the method. 

10 In specific embodiments, a function, such as an addition, a subtraction, a 

multiplication, an exponentiation, a division, a root, a boolean operator, a modulo, an 
absolute value, and the like can be applied to the first subset and second subset of process 
data to provide a third subset of process data. 

The invention also provides, in specific embodiments, a method for 

15 analyzing clinical pathways. This method comprises a variety of elements. For example, 
abstracting clinical data into three or more dimensions, comprising a patient dimension, a 
time dimension, and a procedure dimension is part of the method. The method includes 
providing a two dimensional presentation of the clinical data and a one dimensional 
presentation of the clinical data, enabling visualization of the clinical data in one or more 

20 dimensions. The method further includes indicating a correlation between two or more of 
the three dimensions using the two dimensional presentation, and indicating a quantity 
measure by one or more of the three dimensions using the one dimensional presentation. 
Receiving a selection of one or more of a plurality of regions of interest (ROI), from at 
least one of the three dimensions, is also included in the method. The selection can be 

25 indicated on one or both of the two dimensional presentation and the one dimensional 

presentation. The method further provides for exchanging information about the selected 
ROI between the two dimensional presentation and the one dimensional presentation. 
Then, calculating a first subset of the process data, comprising values present in the ROI 
along one or more of the three dimensions is performed according to the method. Then, 

30 the two dimensional presentation and the one dimensional presentation are redrawn based 
upon the first subset of the process data. 

The invention also provides some graph types to easily compare the 
patterns of selected regions: (1) a 2-dimensional map that shows the difference of two 
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regions, (2) a 2-dimensional map in which color represents the intensities of selected 
regions, and (3) at least two 2-dimensional maps that show each pattern that corresponds 
to each selected region. 

The invention also provides flexible sorting or categorizing in the graphs 
5 to allow users to select ROIs. The invention also provides the system that integrates a 
data retrieval part from warehoused data, a data distribution part, and a data analysis part 
that includes this visualization technique. 

BRIEF DESCRIPTION OF THE DRAWINGS 
10 Fig. 1 illustrates a schematic diagram of a specific embodiment according 

to the present invention. 

Fig. 2 illustrates a flow chart of a selection function in a specific 
embodiment according to the present invention. 

Fig. 3 illustrates a representative screen image of a computer display in a 
1 5 specific embodiment according to the present invention. 

Fig. 4 illustrates one technique for displaying information about some 
selected ROIs on the 2D-map in a specific embodiment according to the present 
invention. 

Fig. 5 illustrates a technique for displaying the information on certain 
20 selected ROIs on a ID-graph in a specific embodiment according to the present invention. 

Fig. 6 illustrates another technique for displaying the information on 
certain selected ROIs on a ID-graph in a specific embodiment according to the present 
invention. 

Fig. 7 illustrates an example of categorizing a patient axis in a specific 
25 embodiment according to the present invention. 

Fig. 8 illustrates a representative system suitable for embodying the 
present invention. 

Fig. 9 illustrates a representative display image of an example analysis in a 
representative embodiment according to the present invention. 

30 



DESCRIPTION OF THE SPECIFIC EMBODIMENTS 
Fig. 1 illustrates a schematic diagram of a specific embodiment according 
to the present invention. A cube 100 shown in Fig. 1 represents multidimensional data. 
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According to the invention, process data is abstracted into a cube having three 
dimensions. For example, the dimensions can include a patient, a time and a type of 
procedure. In the embodiment illustrated by Fig. 1, the three dimensions comprise a 
patient 102, a day, measured from the day of admission 104, and a type of procedure 106. 
5 The patient and the type of procedure dimensions are discrete data, while the day from 
admission can be thought of as continuous data. Fig. 1 also illustrates a 2-dimensional 
map 1 10 (2D-map, or 2D-matrix) that shows the projection of multidimensional data onto 
two dimensions. The two axes of 2D-map are a time 114 and a type of procedure 116. In 
a specific embodiment, the brightness of each pixel shows the frequency of procedures 

10 used. For example, greater brightness in the pixel indicates a higher frequency of use for 
a particular procedure. Fig. 1 further illustrates a 1 -dimensional graph (ID-graph) 120 
that shows the number of procedures used 126 for one or more particular patients 122. 
Thus, the 2D-map 110 shows the integral pattern of each process applied to a patient. 
Whereas, the ID-graph 120 shows the total number of procedures applied to a patient. 

1 5 According to the present invention, a user can select the ROI on each of 

the graphs, for example, and the information of the ROI is interchanged and the 
multidimensional data is sliced according to the selected ROI. The ROI is typically set as 
a subset of the value taken in the dimensions. For example, in Fig. I, a user selects a 
ROI 128 on the ID-graph, 120 which selects a subgroup of patients. Then, an integrated 

20 process pattern applied to this subset of patients is calculated. The 2D-map 1 10 is 

redrawn according to the result of this calculation, and it can show a particular pattern 
corresponding to this subset. On the other hand, if the user selects a ROI 1 1 8 on the 2D- 
map 110, then the number of procedures, of which (time, type) are included in the ROI, 
are calculated and displayed on the ID-graph. 

25 Fig. 2 illustrates a flow chart 200 of a selection function in a specific 

embodiment according to the present invention. In a step 202, if the user selects or 
changes the ROI, then in a step 204, the selected ROI is overlaid on the graph. In a step 
206, the multidimensional data is sliced according to the ROI. Then, in a step 208, the 
other graphs are re-calculated according to the sliced multidimensional data. A key 

30 feature of specific embodiments is that these embodiments enable users (1) to slice the 
multidimensional data while seeing the summarized information in particular 
dimension(s), and (2) to see the results of slicing from the view of the other dimension(s). 
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Fig. 3 illustrates a representative screen image of a computer display in a 
specific embodiment according to the present invention. In Fig. 3, a screen image 300 
comprises two types of visualization devices (2D-map 210 and ID-graph 320) and a 
control panel 370 to configure each visualization device. The control panel 370 provides 
5 control of an x-axis domain 372, a y-axis domain 374 and a range 376 of the 2D-map 
310, and a domain 378 and a range 380 of the ID-graph 320. It also provides controls 
(not shown) for the brightness and contrast of 2D-map, the color table of 2D-map, ID- 
graph type, and so on. By using pointing devices, such as a mouse or a touch panel, ROIs 
can be selected on the 2D-map 310 and the ID-graph 320. By using an input device, such 
10 as a keyboard, the maps and graphs can be configured through the control panel 370. 

Simultaneous display of the control panel 370 and the 2D-map 310 or the ID-graph 320 
is not necessary. 

The invention also provides for a plurality of presentation techniques for 
maps and graphs. While illustrated using a representative embodiment having two 

1 5 visualization devices, a map and a graph, the present invention is not limited to a specific 
number of maps or graphs. Furthermore, a combination of visualization device types is 
not limited to the 2D-map and the ID-graph. For example, the ID-graph 320 can be 
replaced by a second 2D-map to show 4-dimensional data, or the 2D-map 310 can be 
replaced by a 2D-scatter graph to show the distribution of data. Accordingly, 

20 embodiments of the present invention allow users to select appropriate map and/or graph 
types for the data. The invention also provides a plurality of techniques for selecting the 
ROI. In Fig. 1, the ROI is an inner-region of a rectangle that the user selects. However, 
the ROI can be set as an outer-region, an outer-region for one-dimension and an inner- 
region for another dimension, a region having coordinates outside of the rectangle, and so 

25 on. Specific embodiments employing this feature provide users with flexibility in 

selecting the ROI. For example, the user can select as the ROI, "all procedures after three 
days from admission." 

The invention also provides alternative ways to set the ROI. The ROI can 
be set using a threshold in one or more values. For example, the user can set a lower 

30 threshold value in a 2D-map, then the ROI on the 2D-map is set as the cells where its 
value is above the threshold. This enables users to set the ROI according to a normal 
course of clinical procedure. Specific embodiments providing this function can enable 



the user to easily determine which patients did not have the normal course of clinical 
procedure applied to them, for example. 

The invention also provides a plurality of techniques for comparing the 
selected regions. Fig. 4 illustrates a diagram 400 of one technique for displaying 
5 information about some selected ROIs of a 2D-map in a specific embodiment of the 

present invention. A first ROI 418 and a second ROI 419 are selected on the left side of 
the 2D-map 410. These two ROIs correspond to a ID-graph 420 on the right side of Fig. 
4. This enables comparison of the two regions to be made relatively more easily. The 
number of ROIs and the corresponding number of graphs is not limited to two. It is 

10 possible to use more than two ROIs and graphs in specific embodiments. 

Fig. 5 illustrates a diagram 500 of a technique for displaying the 
information on certain selected ROIs on a ID-graph 520 in a specific embodiment 
according to the present invention. A first ROI 518 and a second ROI 519 are selected in 
the ID-graph 520 on the right side of Fig. 5. These two ROIs correspond to two 

15 individual 2D-maps 510a, 510b on the left side of Fig. 5. This technique enables users to 
distinguish the difference in patterns between the two 2D-maps. For example, if the user 
selects two physicians on the ID-graph 520, then the user can compare each physician's 
procedure pattern on the 2D-maps 510a, 510b. The number of ROIs and the 
corresponding number of maps is not limited to two. It is possible to use more than two 

20 ROIs and maps in specific embodiments. 

Fig. 6 illustrates a diagram 600 of another technique for displaying the 
information on certain selected ROIs in a specific embodiment according to the present 
invention. Fig. 6 depicts a first ROI 618 and a second ROI 619 selected in the ID-graph 
620. A calculation 602 is performed on the ROIs 618 and 619, and the result is displayed 

25 on the 2D-map 610 on the left side of Fig. 6. The calculation 602 can be a subtraction of 
the first ROI 618 from the second ROI 619, for example, which enables displaying the 
difference between the two ROIs using, for example, the color and brightness of the 2D- 
map 610. The calculation 602 can apply a function, such as an addition, a subtraction, a 
multiplication, an exponentiation, a division, a root, a boolean operator, a modulo, an 

30 absolute value, and the like. In a specific embodiment, brightness of red and blue color 
can be used for positive and negative values, for example. Accordingly, ROIs 618, 619 
can be compared by using the intensity of colors on the 2D-map 610. In a representative 
example embodiment, if a user selects two patient groups, then the user can see the 
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procedure used particularly in one group drawn as bright red or blue, for example, and the 
procedure used in both of the groups drawn in a dark color, or the like. Results of the 
calculation 602 can be used to set RGB colors representing the intensity of each of the 
ROIs. In this embodiment, the red pixel, for example, on the 2D-map 610 shows the 
5 higher value in the region corresponding to the red color. Accordingly, users can 
distinguish the difference among the ROIs by the color. 

The invention also provides a plurality of techniques for categorizing the 
items by dimensions. Fig. 7 illustrates a diagram 700 of an example of categorizing a 
patient axis in a specific embodiment according to the present invention. In Fig. 7, a 

10 patient axis 702 can be categorized by physician, diagnostics, age, admitting date, and so 
on. A procedure axis 706 can be categorized by the department, operating room, 
pharmacy and so on. This categorization allows users to easily grasp the data from higher 
levels of a hierarchy for each dimension. 

The invention also provides several values to be displayed. In Fig. 1, the 

15 frequency of procedures is displayed. Cost and profit can be displayed, as well. The 
displayed values can differ among various maps and/or graphs. For example, if 
frequency is displayed on a 2D-map and cost is displayed on a ID-graph, then the user can 
analyze the frequency pattern of a procedure while seeing the cost of patients. These 
values can be calculated as a summation in the ROI, or as an average in the ROI. For 

20 example, this function enables analyzing the average profitability from the procedure 
level. 

The invention is also applicable to data models having more than three 
dimensions. Further, users can change the axes of multiple graphs, individually or at the 
same time. 

25 Fig. 8 illustrates a representative system suitable for embodying the 

present invention. In Fig. 8, the arrows represent the data flow. The system shown in 
Fig. 8 comprises a database server 810, an application server 820 and an application client 
830. The database server 810 stores and supplies data. A relational database or a 
multidimensional database, for example, can be used to store and supply the data. The 

30 application server 820 performs data retrieval and data distribution. In a specific 

embodiment, these functions are implemented by data retrieval software 822 and data 
distribution software 824. The data retrieval software 822 retrieves the data, formats it 
and passes it to the data distribution software 824. This action is triggered by a request 
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from the data distribution software 824, by preset schedule, or the like. The data 
distribution software 824 receives the formatted data from the data retrieval software 822, 
stores the formatted data, and passes the formatted data to the application client software 
832. It also stores analyzed data and a template that are created by the application client 
5 830. The data distribution software 824 can conjugate formatted data and templates to 
make analyzed data. The data distribution software 824 can distribute data, analyzed 
data, and templates responsive to a request from the application client 830 or by preset 
schedule. The data distribution software 824 controls which data should be sent to the 
application client 830 taking update timing of data and security into account. 

10 The application client software 832 provides users the analysis 

environment described above. The application client software 832 can store analyzed 
data and template, in a client machine, as well as in the application server 820 through the 
data distribution software 824. This system enables users to distribute and share the 
results of analyses. It also reduces the loading of the database server 810 by storing some 

15 of the analyzed data at the application server 820. 

Furthermore, this system can be modified to improve the performance. In 
this example, the application server 820 sends whole multidimensional data to the 
application client 830. In another embodiment, the application client 830 displays 
multiple maps and/or graphs, while the application server 820 performs calculations such 

20 as data slicing or categorization. In this embodiment, the size of data translation is 

relatively less than in other embodiments, as one-dimensional or two-dimensional data 
are sent from the application server 820 to the application client 830. This modification 
can also reduce a performance requirement for client computers. Fig. 8 also illustrates a 
representative format for storing data, information about ROI and categorization in a 

25 specific embodiment according to the present invention. The data and the information 
about ROIs or categorization are separated. The latter environmental part can be stored 
apart and can be used as a template. This enables users to reuse the setting of ROIs and 
categorizations, which leads to reduction of user operations. For example, users can reuse 
the template even when the data itself is updated. The number of ROIs is not limited to 

30 two. It is possible to use more than two ROIs in specific embodiments. 

Fig. 9 illustrates a representative display image of an example analysis in a 
representative embodiment according to the present invention. Fig. 9 illustrates a screen 
image 900 that comprises two types of visualization devices, a 2D-map 910 and a ID- 
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graph 920, and a control panel 970 to configure each map or graph. Function of these 
components is analogous to correspondingly identified components in the screen image 
300 of Fig. 3, and reference may be had to the description of these components of Fig. 3 
for description of the corresponding components of Fig. 9. 
5 The preceding has been a description of the preferred embodiment of the 

invention. The present invention has been discussed generally with respect to example 
embodiments related to analyzing the course of clinical procedure. However, the 
invention is not limited to this purpose. It can be used for analyzing processes of many 
different types and it can be used for any analyzing a variety of multidimensional data. It 
10 will be appreciated that deviations and modifications can be made without departing from 
the scope of the invention, which is defined by the appended claims. 



